Today, ByteDance's Volcano Engine announced that the Doubao Large Model will release a video generation model on September 24, bringing upgrades to more capabilities in the model family. It is understood that the Doubao Large Model was officially launched at the Volcano Engine Original Power Conference on May 15, 2024.

Recently, foreign media reported that ByteDance is accelerating its efforts to self-develop and manufacture AI chips to reduce dependence on expensive chips from NVIDIA. The report claims that ByteDance plans to collaborate with TSMC and expects to mass-produce two self-developed AI chips by 2026, having already reserved the production of hundreds of thousands of chips. More notably, the report pointed out that ByteDance aims for its self-developed chip clusters to achieve four times the computing performance of a single H100 chip at a similar cost. In response, ByteDance quickly addressed this report.

Recently, the foreign media outlet The Information reported that ByteDance is accelerating the development of its own AI chips and plans to collaborate with TSMC, aiming for mass production by 2026. The report also stated that this move by ByteDance is intended to reduce dependence on NVIDIA chips and lower the costs of developing and operating AI models. Source note: The image is generated by AI and provided by the image licensing service Midjourney, according to reports from the Sci-tech Innovation Board Daily regarding today's media coverage of ByteDance's plans to collaborate with TSMC on AI chips.

With the rise of generative AI, the prompt trading market is rapidly expanding. However, current trading platforms, exemplified by PromptBase, are predominantly seller-driven in pricing and lack objective price measurement standards. In response to this challenge, the multimedia and intelligent security team at Fudan University has proposed an innovative prompt trading model aimed at better adapting to a future buyer-driven market. This new trading model consists of two main phases: prompt category selection and pricing strategy formulation. In the first phase, the platform employs a greedy search-based multi-armed bandit algorithm to...

Recently, Doubao, the educational application from ByteDance's AI smart assistant brand, completed a major upgrade. This app aims to be a smart partner for learners and a valuable assistant for family education, providing support for the new term's studies. 'Doubao Aixue' has introduced multiple auxiliary learning features, including answering questions, homework correction, knowledge Q&A, essay guidance, and mental calculation practice, to meet the diverse needs of family education.

At the main forum of the 2024 Inclusion Bund Conference, Michael Jordan emphasized three key points missing from the current discussions on artificial intelligence: collectivity, uncertainty, and incentive mechanisms. He pointed out that AI systems need to form collaborative collectives and introduce an economic perspective on incentives to build collaborative systems. He noted that AI performs inadequately when facing uncertainty and that humanity's ability to cope with uncertainty through collective collaboration is worth emulating. To enhance the collective collaboration capability of AI systems, Michael Jordan suggested constructing a 'three-layer data market' model.

Sports technology startup SportAI has completed a $1.8 million seed funding round aimed at leveraging artificial intelligence to enhance athlete performance. Its system focuses on coaching, commentary, and analysis of athletic techniques through machine learning, computer vision, and biometrics, primarily serving coaches, training facilities, media broadcasts, and sports brands. SportAI's cloud platform can analyze athletes' technical performance in real-time, providing personalized feedback to help improve levels in sports such as golf and tennis. By comparing with a vast amount of athlete data, the system achieves automation and data-driven insights.

The discussion surrounding programming skills among university professors in India has garnered widespread attention. A study reveals that only 2.5% of Indian engineers possess AI skills, and just 5.5% have basic programming knowledge, raising concerns about the quality of education. Many engineers point out that professors lack adequate programming skills, relying on YouTube videos and online courses for teaching materials, which lack originality and depth. This issue is particularly evident in Tier-3 colleges, where professors often duplicate video content when teaching courses like computer networks. Income disparity is also a significant issue, as university professors' annual salaries...

ByteDance's open-source FLUX Dev's Hyper SD Lora has revolutionized AI drawing speed with its efficient image generation capabilities, shortening the traditional, lengthy process to just 8 or 16 steps. This move not only provides a fast track for creative realization but also establishes a demonstration space on Hugging Face, allowing users to directly experience the drawing effects of the 8-step Lora. Although there is some degradation in image quality, it has minimal impact for most users. Comparison examples show that the degradation is not significant when not enlarged.

ByteDance is secretly preparing to establish a Large Model Research Institute to strengthen its position in AI large models. The institute has attracted top talents from the industry, including Qin Yujia and Huang Wenhao, who will manage technology projects and report directly to founder Zhang Yiming. This move indicates ByteDance's long-term plans and proactive strategies in AI model R&D, aiming to leverage external expertise for technological a....

A research team from Fudan University has developed the 'Concept Erasure Technique' (RECE), which can efficiently and accurately modify inappropriate ideas in AI models, significantly reducing the likelihood of generating inappropriate images while maintaining the AI's other creative capabilities. This technology uses a 'closed solution' to locate and modify specific parts, ensuring the AI behaves more appropriately during creation and stays on track. Experiments show that the RECE technology can effectively enhance the morality and quality of AI creations, providing new directions for the future development of AI, making future AI assistants smarter and more perceptive.

The third edition report of 'Top 100 Consumer Generative AI Applications' released by Andreessen Horowitz reveals popular AI applications and their usage trends. The report shows that content generation tools, particularly in image, video, and music, dominate web applications, with 52% of web products focusing on this area. The music generation tool Suno has notably improved its ranking. In the mobile application sector, image and video editing tools are favored by users, and ChatGPT remains...

At the Volcano Engine AI Innovation Roadshow in Shanghai on August 21, 2024, Volcano Engine showcased a comprehensive upgrade of the Doubao Large Model. This includes the Doubao Text-to-Image Model, which has improved text and image matching capabilities for long texts, the Doubao Speech Recognition Model, which reduced error rates by up to 40% across multiple public test sets, and upgrades to the Doubao Speech Synthesis Model, enhancing streaming speech synthesis abilities for real-time responses and accurate punctuation. Volcano Engine also released a real-time interactive solution for Conversational AI, integrating the Doubao Large Model with real-time audio and video technology, providing end-to-end capabilities.

The Seed-ASR engine launched by ByteDance achieves high-precision recognition of Mandarin, 13 Chinese dialects, and 7 foreign languages through massive training data, significantly enhancing the convenience of cross-language communication. Its key advantage lies in its excellent contextual awareness, accurately recognizing proper nouns, place names, and keywords by incorporating historical information, especially performing exceptionally well in specific scenarios, thereby improving recognition accuracy. Whether in daily conversations, complex meetings, or interactions among multiple people in noisy environments, Seed-ASR can transcribe accurately. It can also recognize various professional terms.

Musk sparked widespread attention by releasing a video of himself dancing with Trump, utilizing an AI video generation tool called Viggle AI, which led to over 130 million views. The magic of Viggle AI lies in its templated operation; users simply upload photos and choose action templates to create smooth, natural dance videos. The tool's multi-character control feature, Multi, further ignited users' creativity, allowing them to produce various creative videos that spread online, bringing a substantial user base to Viggle AI.

ControlNeXt, developed by the Jia Jiaya team, is an open-source image/video generation guidance tool designed to simplify the use of AI models. This tool is lightweight and compatible with models from the Stable Diffusion family, such as SDXL and SD1.5, supporting various control modes, including edge guidance, pose control, masking, and depth of field control. Its 'weight loss secret' lies in adopting a more efficient structure, replacing the 'big eater' control branch with a 'light meal package' composed of a small number of ResNet blocks, reducing the model size.

ByteDance and a research team from Shanghai University of Science and Technology have developed an innovative technology called 'HeadGAP' that can quickly generate highly realistic and animatable 3D virtual head models using just three photos taken from different angles, enabling facial expression synchronization. During the research process, the team first extracted 3D head prior information from a large multi-view dynamic dataset to customize the virtual avatar for the target individual. By utilizing a Gaussian point cloud-based self-decoding network and partial dynamic modeling, in conjunction with inversion and fine-tuning strategies, they efficiently achieved high-quality and diverse...

Tencent has recently launched an innovative educational assistance tool called 'AI Essay Guidance', aimed at helping students improve their writing skills. This feature is based on Tencent's Hunyuan model and is currently available for free on the QQ Browser.

Today, ByteDance announced a new feature for the Doubao model that supports real-time voice calls. It is reported that the conversational AI real-time interaction solution provided by Volcano Engine combines the Volcano Ark large model service platform and Doubao's speech recognition and synthesis models, streamlining the conversion process between speech and text. This solution achieves efficient voice data collection, processing, and transmission, offering outstanding intelligent dialogue and natural language processing capabilities.

The LSLM full-duplex language model developed in collaboration between Shanghai Jiao Tong University and ByteDance revolutionizes traditional AI assistant interaction by enabling real-time conversation where users can listen while speaking. The core advantage of LSLM lies in its ability to simultaneously process speech input and generate output, significantly enhancing the natural flow of dialogue. By integrating streaming self-supervised learning with a token-based decoder, this model supports real-time speech interaction and performs exceptionally well even in noisy environments. LSLM's mid-term fusion strategy strikes the optimal balance between speech generation and real-time interaction, demonstrating impressive noise resistance.